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ABSTRACT . ' ^ . 

A- 3-year project to establish a college-level 
"intertfi scipldna^y computer center/scientific laboratory for 'the 
social sciences is described. The purpose of the project was to 
improve educcition in empir ical,e^d ^ehavioral research methods. The 
center consisjts of computing facilities, a survey research facility, 
a simulation/gaming facility,, and a resident specialist .in .J^ 
quantitative methods. The laboratory i-s not tied to a specific 
curriculum- but rather operates as a free-standing upit avail^le to 
^ali social scientists and students. It contains a variety of ^ 
software^, a library, video recording eguipment. Calculators, audio 
centers, aVid projection equipment. The methods specialist teaches one 
interdisciplinary course per year and works with students and faculty 
on various projects. Although student activity* in the laboratory 
includes both independent and course-related work, the most tangible 
outcomes involve staffing and cur ricular -innovations . Many courses 
have been modifilbd to include compter instruction and use of -the ^ 
center. Currently, more than 80 percent of all social science majors 
have used the facilities. The^project has befen successful in 
providing students with quaTit i tat ive ^instruction. (KC) 
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Comprehensive Assistance to Undergraduate Science Education 
' * X Grant number SER-78--064891 ^. to the educational resources 

Beloit College ^ ^ jnformatjon center (Eric)" 

1 Project Director:. Jerry W. Gustafson 

Department of Economics . 

^ ' , . April 26, ^982 

This report provides a narrative description of a three-yeap plan of activities funded by 
a grant of $138,700 from the CAUSE program of the National Science Foundation. A separate 
evaluation study y^ndertaken by a team' of students and outside consultants was completed in the 
summer of <1981 . A copy of that report is attached. 

The purpose of the plan of activities was 16 improve education in the empirical and be- 
havioral aspects of social science methodology. Beloit faculty had determined that institu- 
' tional strengths in the theoretical and critical traditions of social science were x\ot matched 
by high quality teaching and application of mo<i>?m tools of quantitative and behavioral 
analysis.' Students needed more encouragement to think probabilistically as well as deter- 
miiiistically about social behavior, to address problems in a ^tramework of hypothesis formation 
and tes^ting, to acquire skills in data analysis and, modeling, and t6 engage in research which \ 
would apply olassroom abstractions. Faculty set a general goal of- increasing study time of 
social science students devoted to acquisition and practice of quantitative aiid behavioral 
techniques from less than 10% to at least 20%. , 

The strategy selected was to construct a multipurpose laboratory containing a variety of 
resources necessary for learning empirical techniques and conducting reseai^ch in the dis- 
ciplines of Anthropology, Economics, Government, Psychology and Sociology. The resources in- 
cluded computing facilities, a survey research facility, a simulation/gaming facility for*ob- 
serving and recording social interaction in various controlled- settings, and a resident . 
specialist in quantitative methods. This laboratory was to provide a catalyst to encourage 
existing faculty to upgrade methodological skills, to introduce additional quantitative in- 
struction into the curriculum, and to undertake modest research projects with student teans. 
Such activity had been seriously restricted by inadequate access to computational equipment, 
data resources, and jexpert guidance necessary for those faculty -whose methodological skills 
had grown rusty. ^ 

^ While these laboratory resources were to facilitate and encourage the learning and ap- 

, ^ plication of quantitative techniques, they were not rigidly tied to anticipation of specific 
curricular development. Faculty intended the lab to be a free-standing unit available to 
^ serve all social scientists as their particular needs arose. It was attractively designed to 
encourage frequent visitation by students and to provide maximum opportunity for self-tuition.^ 
' It was to provide an interdisciplinary focus for participating departments and to draw tlje 
O meager resources of individual departments into a more productive critical-mass at the * 
^--Q^ divisionalH[evel*<5here interdepartmental spill-over benef its could become manifest. 

v/) . . • ♦ — • • : ' • ■ . 
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Final Report, continued 

We believe this strategy proved sound and could serve as a useful trodel for other small 
colleges. • 

• ■ / . . > • 

The Social Science Lab oratory 

^ 4 — J 

Approximately $60,000 was allocated to construction of the physical facility, equipment, 
software, and data archives. Following visits by Eeloit faculty to laboratory resources at 
the Universities of California-Santa Barbara, South Carolina, C6nnecticut, Michigan, and other 
sites, we proceeded to adapt others* ideas to appropriate Beloit scale. 

An area of approximately 2000 square feet in the main social ".science building was allo- 
cated to the laboratory project. The major portion of this spacepis divided int9 three ad- 
jacent, and connecting rooms, each having a cominon width of 20 ffi^t and varying in length from 
J8 feet to 30 feet. ,One room contains computational equipment for data analysis. It is ad- 
joined by offices for student lab staff and for the social science metl)ods specialist. The 
other two rooms serve as a simulation lab. They are .outfitted with operable wall which permit 
them to be divided into as many as six small conference roans. The centeimDst of these is 
equipped as an observation/monitoring area with one-way windows overseeing each of the con- 
iference rooms. , The perimeter of the simulation area, is rimmed with fourteen individual car- 
rels, each equipped with telephone and electrical service. 



^ Three other offices are across the corridor from the main laboratory space. One of these 
is soundproofed and is outfitted as a psychological perception lab.^ The others serve as of- 
fices for faculty and students involved in ongoing research and for' game control. 



Fquipment and Resources 



The data analysis room contains two terminals to the College's H-P 3000 mini-computer. 
It also contains six Commodore micro-computers supported by two dual floppy disk drives and 
two dot-matrix printers. A wide variety of software, documentation, machine manuals, etc., 
are available on site.- The micros are ideal for the teaching of BASIC, performing statistical 
chores (with, a statistics package adapted from an Applesoft subset of P-Stat dweloped by Gary 
Grandon, formerly of the Roper Center) and word processing. Larger data sets may be processed 
on the H-P 3000 by SPSS, by an interactive cross-tabulation package called VOTER, developed by 
project consultant Dr. Bruce Bowen, or by other packages. / 

Institutional memberships in the InterUniversity Consortium for Political and Social 
Research and in the International Survey Library Association of the Roper Center provide ac- 
cess to an extremely wide variety of research and public opinion data as well as to the small- 
er teaching data' set? developed by ICPSR for political science SET-UPS qiodules. 

A small libraty of instructional manuals, code books, computing magazines, game packages, 
and other documentary material is available on site. ^ ' 

f 

The gaming area is equipped with a*^ sound system to provide direct communication between 
observation and conference rooms; video recording capability for observation of simulation ac- 
tivity, playing of instructional tapes, etc.; a telephone bank, used for training in survey 
interviewing, conduct of survey^, and as a mode of communication, during gaming; and a variety 
C(f calculators, audio recorders, and projection equipment commonly used in social science 
research and teaching. 
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Faculty Resources 

A social science quantitative methods specialist has been employed with regular faculty 
rank. S,ince this position serves all five participating departments, ii has been located in a 
non-departmental category under the title of "Professor of Behavioral and Social Science." 
Dr. Allen Russell, a quantitative political scientist, has filled this novel position. Dr. 
Russell's classroom teaching has been limited to one interdisciplinary applied quantitative 
methods course per year. The course focuses upon survey research techniques and use of com- 
puter packages. It nicely complements several departmental ly-based methods courses which tend 
to focus more narrowly on techniques Specifically geared to the particular discipline. 

Most of his teaching has. been of a non-classroom variety. He has worked with students 
both individually and in groups, aiding in a variety of problems of research design, machine 
use, and so on. In his close work with student lab staff, he has created a cadre of especial- 
ly competjent students capable of teaching and guiding their peers. 

He has also .worked closely with faculty on an extremely wid^ variety of projects of their 
clioosing. These range from research design, estimating grant proposal costs, help with 
statistical and computer problems, use of games in the classroorfi, locating and obtaining 
necessary data sets, to consulting about curricular change. Equally important, he has- served 
as a vauable catalyst, encouraging many faculty to engage in programs of professional develop- 
ment and curricular change in which they had interest but considerable hesitancy. 

This unusual faculty position has been responsible for much of the success of the overall 
project. It has provided the continuous thrust which is often lacking in projects where most 
participants are distracted by the press of non-project related concerns. We recommend such a 
position to other small colleges— at least where interdepartmental relations permit an easV 
sharing of common resources. . * ^ ' 



Intermediate Impact * . 

*. • 

The process of . implementing the laboratory did stimulate faculty and student interest in 
quantitative and behavioral analysis which was immediate, substantial, arfd which has grown 
steadily. 

Seven social science faculty made site visits to nine laboratory and cbmputing; f acil ities 
at other institutions. Six expert consultants visited Beloit during "the developmental stage 
of the lab and each spoke to a number of social science faculty about how they might prepare 
to use the facility. Eight faculty undertook programs of developing quantitatiye and couiputer 
skills, developing simulations for classroom use, preparing computer exercises for existing 
courses, and other desired activity. Seven faculty conducted a total of tenfcodest research 
projects which drew upon laboratory resources. Each of these employed between one and three 
student as project assistants. 

In sum, 75% (f if teen ;of. twenty) social science faoulp:. participated in depth in develop- 
ing the facility, preparing for its use, or in engaging ifn empirically oriented research. .Ad- 
ditionally, three na'tural science faculty used the facilfi.ty during two summer institutes for 
high school science teachers on use of computers -in secondary level science education. (Thi« 
program, though funded by NSF, was indyenHOTt^ of the CAUSE grant.) In total, the laboratory, 
"although designed for social Science uie, attracted the iUolvemenX of 46% of the entire 
Beloit science faculty* w/ j • 
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Such witie involvement markedly enhanced the attention given and importance assigned to 
quantitatiye aspects of the disciplines. Indeed, the wide and growing interest in computer- 
related activity provided a convincing rationale for the College to upgrade it^ computing cen- 
ter. The installation of an H-P 3000 with (originally) eight remote terminals provided sub- 
stantial unanticipated spill-over benefits to the social science laboratory project. 

• ^ 

Students were as eager to become involved in lab activities as faculty. Approximately 10 
"students per term, and soa,e 30 in all oyer the grant pe'ridd, were enployed as laboratory aids. 
Most of these had -little or no computer or statistical skills at the time of employment. 
The majority of these quickly 'learned the fundamentals of machine operation^ and the BASIC lan- 
guage and were able to give valuable assistance to their fellow students. The staff-aids, 
*rawn from a wid^ range of departments, also provided the nucleus of a suppprtiv^ culture and 
esprit. 

As the l^oratory approached completion, student use grew rapidly. Even before the offi- 
cial opening in March, 1981, between two 'and- three hundred individual students^ per month were 
visiting the facility with some regularity. Many of these were casual users invol-ved in use 
of computer g^es, rudimentary instruction in BASIC, and general study. Even so, most of _ 
these developed f-eelings of comfort with the equipment and the beginnings of computer 
literacy. And many students came to pursue serious tasks and made good progress. Dozens-of 
students found they could use canned statistics packages, particularly regression routines, to 
support their independent research fofr papers assigned in their courses. Many found they 
could learn BASIC with little guidance and wrote programs tailored 'to their own needs. 

Several student teans undertook research projects of their own for public delivery at our 
student research symposium. A Cean of anthropol9g,ists performed an analysis of current stu-^ 
dent opinion using their own cross-tabs program to process the survey dat'a. A political 
science major teaned with an economics major to perform a pr«-e lection study of the Rock Coun- 
ty 1980 Presidential race. An econanics major gathered a" group of student subjects to par- 
ticipate in several experinents in social'choice for wh^ch she utilized the games laboratory. 

While such activities danonstrated that students could leam a great deal on their own if 
provided a conducive enviVonment, fhose students wto -engaged in course work or research which 
called upon specific use of the laboratory facilities made tl?e most substantial and impressive 
gains The new interdisciplinary applied staeistics course .has had perhaps the greatest im- - 
pact The coupling of -instruction i-n a wide variety of statistical techniques with the sunul- 
taneoos teaching of packages such as SPSS has be'en a no.table success. The majority of twenty 
or so sotial science students who have enrolled each year have developed a competence in data 
processing and interpretation of results which exceeds that of virtually any pre-grant Beloit 
student The evidence, though still incomplete, , suggests that tjie in6trui;U^n in statistical 
concepts and machine use' are mutuafly reinforcing. (Limited evidence^so suggests that stu- 
dents having substantial casual exposure to the laboratory environment before enrolling in any 
quantitatively oriented coiirse tend to do better than those who have not.) 

Several other courses, have stimulated student work in quantitative and behavioral issues. 
An anthropology prof essor .has begun to teach the basic math statistics utilizing examples and 
illustrations oriented toward anthropological research and uses t her lab for assigned exei- 
cises A psychology professor supervised a student team who converted a set of programs ob 
tained from CONDUIT' which simulate a variety of experiments in cognition and perception.. Each 
student now runs 'through these experiments as a laboratory component in the course on percep- 
tion A government professor has videotaped 'netwWk election coverage and Qalls upop students 
in A^ierican government to view and closely analyze the impact of various techniques of 
coverage. 'Another government professor has developed modules for his mten^otional relations 
courses for running games such as Guetzkow's "Internation Simulation" and a defense budgeting 

» * * ' * • f » 
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game'which has written. Mr. Russell has trained more than a dozen students in survey 
research and has, with their assistance, conducted a variety of surveys including a Presiden- 
tial Primary study, a post-election Presidentisll study ,^ a needs assessment for a local health ^ 
agency, and a market study for a local library. ' . 

Various other faculty led research projects have called upon many students to perform , 
■specific tasks related to quantitative and behavioral issues. Topics have included lai^age 
development in infants, social characteristics of the Kru people of Liberia, attitudes ot 
litigants in medical malpractice suits, patterns of v preference equalization in international 
trade, an evaluation study of the social science laboratory, and various regression studies of 
^macroec;onanic data. 

. ' y ' . . . ' 

While this work has' been generally good, we would make no special claims about its 

quali'ty. What, is important is th^ recognition that the presence of the laboratory did, in- 
deed, stimulate a considerable variety of activity and ajftention to modem methods :of social 
analysis. The activity simply would not have occurred without the laboratory facility. 

• * ' 1. Institutional Changes 

The most tangible outcomes are indicated by staffing and curricular modifications ^nd in-, 
novations. Perhaps the most significant result, which suggests the faculty's valuation of the 
project, is marked by the College's commitment to continue the position of social science 
methods specialist during the post-grant period. In"the view of participating faculty this 
position has so increased the producti^«<y •of the social science departments, and has con- 
tributed so greatly to the direct education of students in methods, that it is essential to 
continuing program. , . . . • ^ 

Professor Russell has introduced a new course into the curriculum, as has been previously 
mentioned: Behavioral and Social Science 2Q0. The course is an applied quantitative methods^ 
cours^which focuses on teaching use of computer statistical packages. Furthermore, in the ■ ^ 
interjst of achieving greater efficiency than is possible with tutorial techniques, he has 
bcKOT^to teach a group of five one-half unit courses oriented to the most popular lab uses. 
T^ese include "iMicrocomputer Use and the BASIC J^anguage^" "Studying Society Through Games and 
Simulation," ''Exploratory Data Analysis*' .(an elementary presentation of tl^e higiily intuitive 
and inductive approach toward numerical' data pioneered by Tukey and others), "Computer Simula- 
tion of Human Behavior," and "Introduction to Use of Statistical Computing Packages;^* (which 
will be spun-off the BSS 200 course and enlarged to incorporate instruction in the interactive 
P-Stat package and a microcomputer package as well as SPSS and Voter. ) 

We belien^ these new courses, together with modifications described below will complete 
our attempt to provide Beloit students^with the opportunity for breadth and depth in quantita- 
tive orientation desirable at the undergraduat;e level. ' ' " > 

'Courses modified as a result of the grant include, the following: An anthropologist has 
developed^a section of Math 106, Introduction to Statistics, to employ examples from 
anthropology, archaeology and other social sciences^. He also has developed computer simula- 
tion of an archaeology sire and 'various quantitative exercises for- use in his other courses. 
He has also written a program for computer instruction in the Quechba language which is used 
in the "Topics i*n Anthropology^ Course." Economics 206, Macroeconomic Theory, now includes a 
requirement *of a major paper of empirical orientation. The focus of this paper is upon ap- 
plication of regression analysis. Economics 301, Econometrics, and Economics 115, Statistical 
Analysis for Business, have been modified to emphasize time series analysis'so as to comple- 
ment the BSS 200 course. Economics 315, Management and Organization now includes several scr- 
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.cial science games,* Introduction of empirically oriented segments are contemplated for cour- 
ses in Public Sector Economics and Managerial Economics. A deqision has been reached to fill 
an opening ip the department with an applied quantitative person •whase specific interests 
would eatail fostering quantitative research opportunities for. fetudents. 
^ • ' ■ \ ' . 

Goverment, courses^ in International Relations and Inte^naf ioKal Politics now each 
instructional simul-ations as components. The course in Urban Government also includes 
such as the %rban 'Simulation." American Government includes close observation of media 
election coverage and utilizes our videotaping equipment for thak purpose- Eqjpirical modules 
uty.lizing various "set-itf>^" packages are slate<f for inclusion in^An\erican Government and In- 
ternational Relations. 
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The' Psychology 1)epartment has upgraded quantitati^ education in a variety of courses ^ 
since both current full time members are empirically oriented. The most significant change is 
the laboratory component, of Psycho Ipgical Perception which includes computer simulated experi- 
ments in psychophysics. /The psychology perception lab, equipped wuth soundproofing and Com- 
modore 8032, is a permanent fis^ture of that department's program. \ ^ '-^ 

In Sociology ,^ the inethods course has been reoriented to give greater emphasis to statis- 
tical analysis following the participation of the professor in an ICPSR Summer Institute on 
data analysis. . < 

Curricular changes have clearly been extensive. 

i ' ' '.2. Impact u pon St udents ' 

Since the social science labdratbry was designed as a multipurpose resource to be Ishared 
by five departments, ahd not tied to particular courses of instructional study, and since much 
educational enterprise was designed to be self-tuitional, it was difficult to keep records of^ 
precisely who was "receiving instruction" under the project. Since all students receiving ex- 
plicit instruction in courses or applied research were also lab visitors, it .seems best to 
draw conclusions primarily on the basis of daily logs which were maintained to monitor visitsh 
tion during the grant 'period, 

' «l Each student who entered the. lab was apked to sign a log sheet and to enter the purpose 
of the visit, the time and the student* s major. There are numerous pi;oblenis with relying too 
heavily upon information accumulated from such logs. Many signatures are illegible, many per- 
sons tailed to sign in, many had not as yet declared their major. Studenp oft^ would enter 
general t%er^s as "purpose of. visit" such as "clas^' or "study" when they indeed Jepent time on 
the computers, viewing videotapes, browsing through library materials, or in coftversat^n. 

'The level of seriousness of purpose in such visits naturally varied enormously ."^ / 



\ 



Nevertheless,, the log sheets verify faculty impressions that the percentage of students 
enrolled in social science^courses who employed lab services was impressively large. A fairly 
close analysis of several ^nths of lab visitation is include^ in the attached evaluation 
ictudy. As a summary, the*Tollowing table would seen to be tolerably accurate: 
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STUDENT USE OF LABORATORY 
Percentage of Total Number 
Total # of Science * Non-Science 



Year 


Students 


Majors 


Majors 


78-79 


5 


100 




79-80 


■ 105 


95' 


5 


1 80-81 


235 


90 


• 10 


81 -8? 


260 > 


90 


10 


Total 


605 







Women 
2 

30 ' 
35 

35 ■ 



Minor- Handi- Adult t, Prospective 
ities capped Students Te;}chers 



12 
14 
0 



4 
12 

12 



* includes undeclared, but likely science majors 
t includes NSF summer science teachers institute 

• The students involved in the laboratory and related activities constitute more than 25% 
of/the entire student body. Approximately 80% of all social science majors and 10% of natural 
science majors have used the facilities and have received instruction luider the grant. 

The extensive changes in student attitudes toward quantitative work and skills in ajj- 

■ plication of them are obvious to faculty. Students already take the laboratory rather for 
granted. It seems far more' na'tural to them to be assigned quantitative tasks than was former- 
ly the case. There is -a growing culture among frequent lab users which is more professional 

■ and serious in orientation than was formerly the case. Although we are far from finished with 
the task of working the lab into the total educational experience of students, there 'are, 
nonetheless, large numbers of students learning computing and statistics, participating in 
surveys, running SPSS, and engaged in other aspects of empirical and behavioral work. Sky- 
rocketing enrollments in introductory computer science and statistics have partially been the 
result of the opportunities the lab offers. Since virtually none of this activity was going . 
on three years ago, we think we have made impressive progress. 



Evaluation \ 

One of the novel aspects of the grant was the employment of a team of ^student par- 
ticipants as evaluators of the project. Six students worked under the direction of an outs^^ide 
consultant, Profl.' Jeffrey Miller of Lawrence University. Dr. Miller- called three other 
evaluation researchers as additional consultants -in this project. This groupjof outsiders., 
coordinated by the Project Director, made a total'of nine visits, mostly of two days, during 
the spring, 1981, sgmester. They provided the team with a workshop in evaluation research and 
had them apply their learning to an evaluation study of the laboratory itself. 

Although the students we're naturally , hampered by lack of measurement^ of outcomes, they 
fOBhd "that lab use had been extensive, that students and faculty alike widely shared the , 
opiniori.-tiiat it was a valuable, even essential, addiUon to Beloit program, and that students' , 
were inS'e^ growing increasingly comfortable with and proficient in quantitative techniques. , 
Although -the report may fall short of high prof essieii^lism, it was of considerable value- to 
lab administration." The students reported great satisfaction with what they had learned fron, , 
being permitted to participate in the evaluation. A copy of the final report is attached. . 
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Conclusion . 



. / 



The original grant proposal and budget were followed nearly to the letter. The program 
of .activities achieved substantial success in improving the Beloit educational environment 
where i't t/^s weakest,. 

Submitted by 
Jerry Gustaf son 
Project Director 
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Attachment 1 
Faculty Participants in the Proiect 



AnthropoloRv " 

Professor Daniel Shea 
Professor Lawrence Breitborde 

Economics 

Professor Jerry Gustafson 
Pxofessor Emil Kreider 
, Professor Lester McAllister 
Professor James Ozzello 

Government 

Professor Milton F^der 
Professor Warner Mills 

PsycholoRv J 

Professor Geoffrey Magnus 
Professor Roland Reboussin * 
Professor Allen Raffetto 
Igrofessor Debra Poole 

Sociology 

Professor Menno Froese 
Pro^esjor Marlynn May 

Social and behavioral Science 
Professor Allen Russell 



NSF Science Teachers Summer In stitute St afj 
Professor John Jungck 
Professor Paul Campbell 
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Attachment 2 
Proiect Consultants 

1. Laboratory development and implementation 

« * * * 

Dr, John Stucker, Professor of Political Science and Director of the Social and Behavioral 

Science Laboratory, University of South Carolina 
Dr. James Davis, Professor of Sociology, Harvard, University 

Dr. Gregory Marks, Director of Computer Support, Inter-University Consortium for Social^ 

and Political Research • , / 

Dr. Fred'Goodman, Professor, College of Education, University of Micliigan ^ ^ ^ • 

Dr. Bruce Bqwen, Corporate Economist Blue Cross of Northern California 
Dr. Gary Grandon, Assistant^^^^Lrector for Computer Services, The Roper Center 
Dr. Gordon Stephenson, Animal Behavior Laboratory, University-of Wisconsin-Madison . 

2. Computer JResourcesP ^ " ^ ^ 
Karl M*atzke, President, Madison Computer Store 

William Hinrichs, .Prof essor of Matheipatics , Rock Val4ey College - 

3. Evaluation 

Dr. Jeffrey Miller, Prof, of Political Sc^ience and Director of Public Policy Program, 

Lawrence University 
Dr. Robert Haverman, Prof, of Economics, University of Wisconsin-Madison 
Dr. William Gonnley, Prof, of Political Science, University of* Wisconsin-Madison 
Dr. James Davis, Prof, of Sociology, Harvard University " ^ 
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